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Abstract 

Reading achievement scores for adolescents with disabilities are markedly lower than the scores of adolescents without 
disabilities. For example, 62% of students with disabilities read below the basic level on the NAEP Reading assessment, 
compared to 19% of their nondisabled peers. This achievement gap has been a continuing challenge for more than 35 
years. In this article, we report on the promise of a comprehensive 2-year reading program called Fusion Reading. Fusion 
Reading is designed to significantly narrow the reading achievement gap of middle school students with reading disabilities. 
Using a quasi-experimental design with matched groups of middle school students with reading disabilities, statistically 
significant differences were found between the experimental and comparison conditions on multiple measures of reading 
achievement with scores favoring the experimental condition. The effect size of the differences were Hedges’s g = 1.66 to 
g - 1.04 on standardized measures of reading achievement. 
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The Ongoing Challenge 

Overall, the findings reported in the 2013 National 
Assessment of Educational Progress (NAEP) relative to 
reading outcomes are encouraging for some learner groups. 
For example, scores for eighth grade students in general 
improved slightly. In stark contrast, however, data for eighth 
grade students with disabilities show that these students 
continue to do poorly. Fully 62% of students with disabili¬ 
ties read below the basic level on the NAEP reading assess¬ 
ment compared to 19% of their nondisabled peers ( National 
Center for Education Statistics, 2013). Students who score 
at the below basic level are unable to use prior knowledge 
to make a comparison, describe the central problem faced 
by a main character, use context to identify meaning of 
vocabulary, provide text information to support a general¬ 
ization, read across text to provide an explanation, or sup¬ 
port an opinion with text information or related prior 
knowledge. In a very real sense, students reading at the 
below basic level are unable to comprehend much of the 
written material they encounter in school. 

The challenges facing students with low reading achieve¬ 
ment may become even more pronounced. With the adop¬ 
tion of the Common Core State Standards (CCSS), students 
with poor reading proficiency will likely face measures 
with increased rigor (National Governors Association 


Center for Best Practices & Council of Chief State School 
Officers, 2010). Thus, students who score poorly on current 
measures of reading comprehension may score even lower 
on the more rigorous CCSS aligned measures (e.g., Editorial 
Board, 2013). 

The Need for Solutions 

Low levels of reading achievement are also related to poor 
school outcomes. For example, about 20% of the lowest 
level readers will drop out of high school by the end of their 
sophomore year (Dalton, Glennie, Ingels, & Wirt, 2009). 
Indeed, the number of students with disabilities to graduate 
from high school actually declined between 1998 and 2005 
(Blackorby et al., 2010). The consequences of not 
graduating have been well documented; dropouts have 
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higher unemployment rates and earn lower wages (U.S. 
Department of Labor, 2003). In sum, academic and social 
performance gaps for students with disabilities significantly 
limit educational success and overall life opportunities for 
this population (Carnegie Council on Advancing Adolescent 
Literacy, 2010; Lichtenstein & Blackorby, 1995). 

The Evidence We Have 

Recent studies and meta-analyses of reading interventions 
and programs for adolescents with reading disabilities have 
informed our understanding of what works with whom and 
under what conditions (e.g., Gersten, Fuchs, Williams, & 
Baker, 2001; Slavin, Cheung, Groff, & Lake, 2008; 
Swanson, 1999a; Swanson & Hoskyn, 1998; Torgesen, 
2005; U.S. Department of Education, Institute ofEducation 
Sciences, 2013). Findings from these studies are helping to 
expand our understanding of the science of reading instruc¬ 
tion for adolescents with reading disabilities. We review 
this research below. 

In a meta-analysis of reading research on students with 
learning disabilities, Swanson (1999b) found that certain 
principles supporting effective word recognition and read¬ 
ing comprehension had a positive impact on reading out¬ 
comes for children and adolescents with learning disabilities. 
The Swanson study included 92 separate studies conducted 
between 1972 and 1997. All of the children and adolescents 
in these studies were identified as having specific learning 
disabilities. Findings from the analysis indicated that inter¬ 
ventions that combined direct instruction and reading strat¬ 
egy instruction were the most effective for teaching reading 
comprehension. In addition, Swanson found that direct 
instruction alone was most effective for teaching word rec¬ 
ognition. Furthermore, he found that when researchers 
combined direct instruction and reading strategy instruc¬ 
tion, a large effect on student outcomes was obtained (ES = 
1.15). Finally, Swanson found that direct instruction of 
word recognition also had a large effect (ES = 1.06). 

In a meta-analysis by Scammacca et al. (2007), research¬ 
ers studied findings from 31 studies of adolescent strug¬ 
gling readers. Researchers focused their attention on 
interventions designed to affect reading fluency, vocabu¬ 
lary, and reading comprehension. Researchers sought to 
answer three primary research questions: (a) How effective 
were the reading interventions from these studies for ado¬ 
lescent struggling readers? (b) What was the specific impact 
of these reading interventions on measures of reading com¬ 
prehension? and (c) What was the specific impact of these 
reading interventions on students with learning disabilities? 
Similar to the Swanson analysis, researchers found that 
teachers could influence reading outcomes for older stu¬ 
dents with reading difficulties and that adolescents, includ¬ 
ing those with learning disabilities, could benefit from 
interventions that target both word-level and reading 


comprehension strategies. Researchers also found that 
teaching vocabulary had a positive impact on reading com¬ 
prehension for older students with reading disabilities. 

In a related meta-analysis, Berkeley, Scruggs, and 
Mastropieri (2010) synthesized findings of 40 studies for 
improving the reading comprehension of approximately 2,000 
students with learning disabilities. Researchers found that the 
use of reading strategy instruction for students with learning 
disabilities showed moderate to high effectiveness across the 
studies. Researchers also found that text enhancements were 
effective in helping students with learning disabilities leam 
reading comprehension strategies. These text enhancements 
included in-text question placement, graphic organizers, and 
use of technology. Finally, researchers found that teaching 
students with learning disabilities reading skills using pack¬ 
aged interventions in small groups was an effective method 
for increasing reading comprehension. These findings sup¬ 
ported the analysis conducted by Swanson (1999b) and 
Scammacca et al. (2007) that reading strategy instruction was 
effective for students with learning disabilities. 

Galuschka, Ise, Krick, and Schulte-Korne (2014) 
reviewed 22 randomized controlled trials (RCTs) on read¬ 
ing interventions for children and adolescents with reading 
disabilities. The researchers evaluated 49 comparisons of 
experimental and comparison groups that included reading 
fluency, phonemic awareness, reading comprehension, pho¬ 
nics instruction, auditory training, medical treatments, and 
interventions with colored overlays or lenses. Researchers 
concluded that phonics instruction was the most frequently 
used treatment approach that used an RCT design and that 
phonics instruction was the only approach whose efficacy 
on reading and spelling performance in children and adoles¬ 
cents with reading disabilities was statistically confirmed. 
This meta-analysis demonstrated that severe reading and 
spelling difficulties could be treated with appropriate 
instructional methods. The authors concluded that system¬ 
atic instruction of letter-sound correspondences and decod¬ 
ing strategies was the most effective method for improving 
the literacy skills of children and adolescents with severe 
reading disabilities. 

Sencibaugh (2007) conducted a meta-analysis of 15 
studies of reading comprehension interventions for K-12 
students with learning disabilities. Results of the synthesis 
found an effect size of 0.94 for reading comprehension 
and 1.18 for auditory language strategies. One of the key 
findings from this analysis was that language dependent 
strategies had a significant impact on reading comprehen¬ 
sion skills of students with learning disabilities. Second, 
questioning strategies that involved instruction in para¬ 
graph restatements along with strategies for text structure 
analysis yielded the most significant outcomes. The 
authors also found that the effects of visual and auditory/ 
language strategies produced positive outcomes for stu¬ 
dents with learning disabilities. Finally, the authors found 
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that interventions that involved metacognitive strategies 
produced larger effect size gains. Overall, and consistent 
with other findings, the results from the synthesis sup¬ 
ported the critical importance of teaching students with 
learning disabilities to effectively use specific strategies to 
support reading comprehension. 

In a synthesis of 29 studies, Gajria, Litendra, Sood, and 
Sacks (2007) found that several types of interventions were 
effective in improving the comprehension of expository 
text by students with learning disabilities (LD). The studies 
were grouped by intervention type into content enhance¬ 
ment and cognitive strategy instruction. Content enhance¬ 
ment included interventions that used instructional devices 
(e.g., advance organizers, visual displays, mnemonics, etc.). 
In all, 11 studies were included in the content enhancement 
analysis with an overall finding that content enhancement s 
provided strong support for the use of instructional devices 
for students with LD. Specifically, researchers found a large 
effect size (d = 1.06) for students with LD on measures of 
content comprehension. 

In the review of cognitive strategy instruction, research¬ 
ers divided studies into single-strategy and multiple-strat¬ 
egy interventions. Researchers found that the 15 
single-strategy interventions from 10 studies resulted in 
very large gains for students with LD. The effect size gain 
for single-strategy studies was 1.83. Results for multiple- 
strategy studies showed even larger gains with an overall 
effect size of 2.11. 

Since the analyses described above were conducted, 
researchers have continued to study reading instruction for 
students with learning and reading disabilities. For exam¬ 
ple, Vaughn, Swanson, and Solis (2013) reported the results 
of a longitudinal study of reading comprehension interven¬ 
tions for adolescents with LD who were situated within a 
response to intervention model. In this study, researchers 
developed interventions across three tiers of instruction, 
with increasing levels of intensity for students who were 
nonresponsive to less intense instruction. 

The results of the Tier 2 and Tier 3 interventions on stu¬ 
dent reading achievement scores showed larger gains for 
the experimental groups than comparison students. 
However, the impact was considered small (d = 0.16). This 
finding also held for students identified as having an LD, 
although students with LD performed significantly below 
the mean of the typical struggling readers in the Tier 3 inter¬ 
vention. This study supported the findings from previous 
studies but clarified the need for intensive instruction. That 
is, even with explicit and intensive reading instruction, stu¬ 
dents with severe reading disabilities demonstrated limited 
reading improvement. 

In another study, Lovett, Lacerenza, De Palma, and 
Frijters (2012) reviewed the impact of the PHAST PACES 
reading program with high school struggling readers. 
Results from this study showed that experimental group 


students made statistically significant gains when compared 
to a comparison group. In addition, the overall gains were 
moderate (Cohen’s d = 0.68). However, gains deteriorated 
over time. The authors concluded that while the one semes¬ 
ter of PHAST PACES was promising, it did not provide suf¬ 
ficient remediation to narrow the achievement gap for 
students with severe reading deficits (Lovett, Barron, & 
Frijters, 2013; Lovett et ah, 2012). 

In an effort to examine the effects of peer-mediated and 
teacher-led interventions on high school student reading 
outcomes, Bemboom and McMaster (2013) used the peer- 
assisted learning strategies (PALS) model (Fuchs, Fuchs, & 
Burish, 2010; Fuchs, Fuchs, Mathes, & Simmons, 1997) to 
determine if a more cost-efficient intervention would be as 
effective as a teacher-led intervention. In both conditions, 
students practiced reading fluently and using comprehen¬ 
sion strategies. However, in the PALS condition, peers 
practiced with each other and in the teacher-led condition, 
the teacher provided multiple models of expert reading and 
use of reading strategies. Both experimental groups were 
compared to students in a comparable school. Results of the 
data analysis showed that there were no statistical differ¬ 
ences on the AIMSweb maze measure (Pearson, 2012) 
between the PALS and teacher-directed groups. In addition, 
there were no statistically significant differences between 
the PALS and teacher-directed groups on the AIMSweb oral 
reading fluency measure. When compared to the nonequiv¬ 
alent comparison group, both experimental groups outper¬ 
formed the comparison group on the AIMSweb maze test. 
Specifically, the teacher-directed group had a statistically 
significant and large effect on the maze text (Cohen’s d = 
0.69) and the PALS group had a statistically significant and 
very large effect (Cohen’s d = 1.00) on the same measure. 

In a large experimental study designed to measure the 
effects of integrating teacher knowledge building activities 
and student-regulated comprehension strategies in 7th to 
10th grade English language arts classes, Simmons et al. 
(2014) reported that integrating teacher knowledge building 
activities and student-regulated comprehension practices in 
core English language arts classes was as effective as tradi¬ 
tional English language arts instruction for students reading 
at or below the 30th percentile as measured by the Gates- 
MacGinitie Reading Comprehension subtest. About 5.6% 
of the students were students with disabilities. 

Simmons et al. (2014) found that while there were no 
statistically significant differences between groups, effect 
size gains favored the experimental condition. That is, on 
the fourth edition of the Gates-MacGinitie Reading Test, a 
distal measure of comprehension, researchers found an 
effect size gain of Hedges’s g = 0.46. This finding supported 
previous findings that more intensive instruction may be 
needed for low performing students (e.g., Vaughn, Roberts, 
Klinger, Swanson, & Burdman, 2013; Vaughn & Wanzek, 
2014; Wanzek, Vaughn, Roberts, & Fletcher, 2011). 
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The Ingredients for Instructional Success 

Taken together, the research described above represents a 
significant body of evidence-based practices. It is important 
that the studies and reviews indicate that it is not too late to 
teach adolescents with disabilities to become better readers 
and that adolescent struggling readers can benefit in signifi¬ 
cant ways from reading instruction (Edmonds et al., 2009; 
Scammacca et al., 2007; Swanson & Hoskyn, 1998; 
Torgesen, 2005; Vaughn et al., 2013). In addition, this 
research highlights several common instructional practices 
that impact reading achievement. These practices include 
the following: (a) explicit instruction—all studies included 
some variation of explicit instruction to teach students 
skills, strategies, or specific knowledge; (b) teaching stu¬ 
dents multiple cognitive and metacognitive strategies for 
word-level reading, vocabulary, and reading comprehen¬ 
sion; (c) use of cooperative learning activities; (d) teaching 
reading comprehension in both small groups (about 5 stu¬ 
dents) and somewhat larger groups (12-15 students); (e) 
performance feedback by peers or teachers; and (f) standard 
protocol interventions as individualized interventions for 
most adolescents with LD. Thus, a foundation of effective 
instructional practices has been identified and aspects of 
these effective practices have been integrated into many 
adolescent reading interventions. However, until recently, 
few comprehensive interventions have been developed that 
include all of the effective practices described above. 

In 2006, with a grant from the Institute of Education 
Sciences (PR/Award R305G040011), researchers at the 
University of Kansas Center for Research on Learning 
began work to create such an intervention. The resulting 
program became known as Fusion Reading. Several key 
features distinguish this program. First, Fusion Reading is 
comprehensive in scope. It contains instruction that research 
has identified as necessary for approximately 80% of all 
struggling readers: phonics, decoding, word recognition, 
fluency, vocabulary, and comprehension (see Brasseur- 
Hock, Hock, Kieffer, Biancarosa, & Deshler, 2011; Hock & 
Brasseur-Hock, 2009; Hock et al., 2009). Second, reading 
skills and strategies are taught explicitly in a step-by-step, 
cumulative process. That is, each step of a strategy is taught 
to mastery, and then all steps are taught together to mastery. 
This process addresses working memory limitations of 
many students with reading disabilities. Third, students and 
their teachers engage in structured cooperative learning 
activities. While peers practice reading together and take 
turns as the reader and the coach, the teacher circulates and 
gives elaborated feedback to students. Thus, peer collabora¬ 
tion is supplemented with teacher instruction and feedback. 
Fourth, instruction takes place both in small groups and 
somewhat larger groups. For example, when practicing 
skills and completing activities, students work either with a 
partner or in a small group of three to four students. Fifth, 


Fusion Reading is a standard protocol that can be used with 
all students, including those with disabilities. Materials are 
simply adjusted according to individual needs. Finally, 
teachers provide structured and scaffolded opportunities for 
students to generalize and apply reading skills and strate¬ 
gies to core class and state-level reading assessment materi¬ 
als. Structured opportunities to apply skills and strategies to 
actual core materials and assessments and received feed¬ 
back helps bridge the gap between what happens in a sup¬ 
plemental reading class and the actual reading demands 
students face in core classes. 

Multiple studies have been conducted with Fusion 
Reading. Among them are the following. 

Study I. As a part of an 1ES grant (PR/Award 
R305G040011), an underpowered random assignment 
study was conducted with Fusion Reading (FR; Hock, 
Brasseur-Hock, & Deshler, 2012). The control condition 
was Second Chance Reading (SCR; Joyce, Showers, 
Scanlon, & Schnaubelt, 1998). All students were adminis¬ 
tered the Group Reading and Diagnostic Evaluation 
(GRADE; Williams, 2001). An independent analysis of 
the data was conducted. A total of 34 students received 
instruction in FR, and 35 students received instruction in 
SCR. The data were analyzed using a hierarchical linear 
modeling (HLM) approach as implemented in SAS PROC 
MIXED. The dependent variables were the standard and 
raw scores on the GRADE comprehension composite test 
score. A significant interaction was found between treat¬ 
ment and measurement occasion for the standard score on 
the GRADE Composite comprehension score, F( 2, 88) = 
3.53, p = .03. The pre to post gain for the experimental 
group was statistically significant, F( 2, 88) = 4.59 ,p = .01. 
The effect size (Hedges’s d) for this subtest score was 
0.70, F( 2, 93) = 3.06, prob = .05, for the raw score and 
0.66, F( 2, 93) = 3.73, prob = .03, for standard scores. 

Study 2. A large (n = 871 students) RCT was carried out as 
part of a Striving Readers project. Funded by the Depart¬ 
ment of Education (DoEd), this study was evaluated inde¬ 
pendently by SRI (Schiller et al., 2012). The RCT examined 
the effects of FR, using intent-to-treat, on the reading 
achievement and motivation of adolescent struggling read¬ 
ers. Eligible struggling readers were assigned randomly to 
either the FR intervention or a “business as usual” compari¬ 
son condition. Results were analyzed for only Year 1 of the 
program; the Striving Readers projects were not funded for 
Year 2 due to DoEd budget cutbacks. A statistically signifi¬ 
cant impact was found for the intervention on the Sight 
Word Efficiency (SWE) subtest of the Test of Word Reading 
Efficiency (TOWRE), with an effect size (Glass A) of 0.11. 
In a supplemental analysis of students who actually received 
FR, Fusion students had significantly higher TOWRE SWE 
(p < .05, ES = 0.10) and GRADE sentence comprehension 
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(p < .05, ES = 0.15) at posttest than comparison group stu¬ 
dents. There were no significant differences on measures of 
reading comprehension. 

Study 3. A single-group pre-/posttest design study was con¬ 
ducted in a large urban city in the Southeast. All 266 stu¬ 
dents in the study had individualized education programs 
(IEPs) and reading goals. In all, 22 middle school teachers 
participated in the experimental condition. Students were 
pretested early in the fall of 2012 and post tested 4.5 months 
later in January 2013. The reading measure was the Test of 
Silent Contextualized Reading Fluency (TOSCRF; Ham- 
mill, Wiederholt, & Allen, 2006). Analyses of scores on this 
measure were calculated for raw score and grade-level 
scores. The results of the analyses indicated that there were 
statistically significant differences between pre- and post¬ 
test scores for the group [p = .000, d = 0.55). Grade-level 
gains as measured by the TOSCRF were statistically sig¬ 
nificant (p = .000, d = 0.51), with a mean grade-level gain 
after 4 months of instruction of close to 1 year (0.92). 

Expanding the Evidence 

Between 2010 and 2012, another study of FR was con¬ 
ducted to answer the following research questions: 

1. What was the impact of the intervention on the read¬ 
ing achievement of middle school students with 
reading disabilities? 

2. What was the magnitude of the gain score difference 
(effect size) for the intervention when compared to 
the comparison condition? 

3. Was the magnitude of gain scores significantly dif¬ 
ferent for students who received the intervention for 
2 years as opposed to students who received the pro¬ 
gram for 1 year? 

4. Did teachers implement the content and instruc¬ 
tional practices of the intervention with fidelity? 

Two studies evolved from this research. Study 1 took 
place during the 2010-2011 school year and answered 
Research Questions 1 and 2. Study 2 took place during the 
2011-2012 school year and answered Research Questions 1 
and 3. The research surrounding these studies is reported in 
the following section. 

Method 

Setting 

Both studies were conducted in a medium size urban school 
district in the Midwest. The district had an enrollment of 
approximately 10,500 students with two public high 
schools, three middle schools, and 13 elementary schools. 


All three middle schools were involved in the studies. The 
participating middle schools had a student population in 
which 15.9% of the students had active IEPs, 3% of the 
students were classified as English language learners, 16% 
of the students were representative of diverse groups, and 
40% of the students were classified as living in low SES 
households. 

Student Participants 

A total of 40 sixth grade special education students partici¬ 
pated in the studies. They were served in both core classes 
and in special education supplemental classes. Students 
were classified by level of special education support pro¬ 
vided. For example, students were classified as “more 
severe” if they were served in special education classes 
30% to 50% of their instructional time. Students were clas¬ 
sified as “less severe” if they were served in special educa¬ 
tion classes 10% to 25% of their instructional time. All 
students had active IEPs that included reading goals. Of the 
students, 35 (86%) were identified on their IEP as having an 
LD and 5 (4%) of the students were identified on their IEP 
as having a hearing impairment. Sign language interpreters 
were present in all classes that included students with a 
hearing impairment. 

Table 1 presents the sociodemographic characteristics of 
the study sample. Student participants were recruited from 
three middle schools. The majority of the students were 
male (n = 27, 67.5%), were Caucasian (« = 26, 65.0%), 
received free or reduced lunches (n = 22, 55.0%), and spent 
30% to 50% of their time in special education classes (n = 
22, 55.0%). The sociodemographic characteristics of the 
sample did not differ between the experimental and com¬ 
parison groups (see Table 1). 

Teacher Participants 

A total of 8 sixth grade special education teachers who 
expressed interest in the studies and signed letters of con¬ 
sent were selected to participate; 5 teachers taught FR, the 
experimental intervention, and 3 teachers taught Corrective 
Reading, the district’s current reading program and com¬ 
parison condition. All teachers were certified by the district 
as highly qualified to teach students with disabilities, had 
taught reading in the district for at least 2 years, and had 
taught the district’s current reading program during the past 
school year. 

The Experimental Condition 

FR was the intervention used in the experimental condition. 
In this study, FR was taught in small groups of students 
(3-8) who met regularly in 50-min sessions five times a 
week throughout the school year. 
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Table 1 . Sociodemographic Characteristics of Study Sample. 

Variable 

All (N 

= 40) 

Intervention (n = 20) 

Comparison 

(n = 20) 

x 2 

df 

p 

Cramer’s V 

n 

% 

n 

% 

n 

% 

Gender 







1.03 

1 

.311 

0.16 

Female 

13 

32.5 

8 

40.0 

5 

25.0 





Male 

27 

67.5 

12 

60.0 

15 

75.0 





Race 







0.00 

1.00 

1.000 

0.00 

Other 

14 

35.0 

7 

35.0 

7 

35.0 





Caucasian 

26 

65.0 

13 

65.0 

13 

65.0 





SES 







0.00 

1.00 

1.000 

0.00 

Free/reduced lunch 

22 

55.0 

1 1 

55.0 

11 

55.0 





Regular lunch 

18 

45.0 

9 

45.0 

9 

45.0 





Disability severity 







0.40 

1.00 

.525 

0.10 

30-50% 

22 

55.0 

10 

50.0 

12 

60.0 





10-25% 

18 

45.0 

10 

50.0 

8 

40.0 






Note. Disability severity is defined as the percentage of time the student was served in special education classes. When not served in special education 
classes, students were included in general education for the remaining percentage of time. 


A 2-year supplemental reading program, FR includes 
seven instructional units is designed to meet daily for one 
50- or 60-min class period each instructional day (Hock 
et al., 2012). The course does not replace language arts or 
other core classes but is supplemental to core classes and is 
usually offered as an elective. The authors suggest that FR 
be taught in classes consisting of no more than 12 to 15 low- 
achieving readers in sixth to eighth grade who typically 
score two or more grade levels below grade placement on a 
standardized or state reading assessment measure. Four 
main components are bundled into the program: (a) Word 
Level Skills, (b) Comprehension, (c) Motivation, and (d) 
Assessment. Each component is described below. 

The Word Level component is taught through The 
Bridging Strategy (TBS). Bridging consists of four core 
units: phonics, decoding, word identification, and reading 
fluency. When students apply TBS, they use multiple skills 
and strategies to help them quickly and accurately recognize 
words in text. For example, when students encounter an 
unfamiliar multisyllabic word, they attempt to say combina¬ 
tions of letters and blend them into a word that is in their 
listening vocabulary. If that doesn’t work, they analyze the 
beginning and ending letters of the word. Again, students 
say each word part and blend them together. If the word is 
still unrecognizable, students proceed to the next step of the 
strategy and review the remaining letters to find and pro¬ 
nounce the syllable(s). Here, students are taught to find high 
utility syllable patterns and say each part of the word blend¬ 
ing the parts. If students recognize the word, they reread the 
word in context to check the meaning. If students do not 
recognize the word, they ask another person, use a diction¬ 
ary, or use the computer to figure out how to say the word 
and what the word means. These word skills are taught to a 
level of automaticity through fluency instruction. 


The Comprehension component of FR consists of three 
key strategies, each of which includes multiple substrate- 
gies that support close reading and comprehension. First, 
students leam the Summarization Strategy. With this strat¬ 
egy, students make multiple passes for multiple purposes 
through the material by finding clues in reading material, 
linking the material to prior knowledge, reading short 
chunks of information, finding main ideas and paraphrasing 
the ideas, and summarizing sections of text material. 
Second, students leam the Prediction Strategy. With this 
strategy, students leam to make meaningful predictions 
about the text and draw inferences. Finally, students learn 
the Vocabulary Strategy. This seven-step process includes 
group, partner, and individual morphological word analysis 
and extensive discussion and application of context-based 
vocabulary words. Students also leam how to determine the 
meaning of unknown vocabulary through the analysis of 
affixes and context clues and extensive classroom discus¬ 
sion of multiple word meanings, word usage in a variety of 
contexts, and similarities of the target word to other words. 

Two activities embedded in the Comprehension compo¬ 
nent, Thinking Reading and Book Study, are designed to 
increase the amount of time disengaged readers spend 
engaged in the reading process. First, Thinking Reading is 
an instructional process teachers use to demonstrate expert 
reading behaviors, to forecast strategy application, and to 
provide opportunities for students to practice strategy appli¬ 
cation in the context of authentic reading material. Thinking 
Reading is similar to Reciprocal Teaching (Palincsar & 
Brown, 1984) in that the teacher eventually transfers the role 
of expert reader to students. However, in Thinking Reading, 
teachers use highly engaging reading materials in an effort 
to get disengaged readers reengaged with text. Second, Book 
Study is designed for extension and application of learned 
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reading strategies outside the classroom. Students select 
books in their areas of interest and at their independent read¬ 
ing level. Then they complete assignments that are directly 
related to the strategies and vocabulary being taught. The 
goals of these activities are to get disengaged readers’ “eyes 
on print” (Vaughn, 2006, p. 172), provide multiple expo¬ 
sures to expert reader models, provide readers with an 
opportunity to practice new reading strategies, and extend 
reading practice beyond the classroom. 

The Motivation component has several key elements. 
These elements include the use of highly engaging teen lit¬ 
erature, instructional lessons designed for student success, 
goal setting and performance tracking, and Possible Selves 
for Readers (PSR). PSR is used to focus students’ attention 
on the importance of becoming an expert reader and, more 
important, how being an expert reader can help them reach 
their hopes and dreams as learners, persons, and in a career 
area. For example, students participate in structured inter¬ 
views in which they describe themselves as an individual, 
as a learner, and as a worker. They also identify their hopes, 
expectations, and fears for the future in each of these areas. 
These multiple visions of hoped for, expected, and feared 
selves can be motivating (Markus & Nurius, 1986). From 
this examination of what is possible for each individual, an 
action plan is developed that clearly shows the linkage 
between reading and the attainment of the goals identified 
by the student. PSR is an ongoing experience and reflects 
the dynamic nature of student goals. PSR is revisited 
throughout the 2-year course, with goal progress monitored 
by both the student and teacher. 

The Assessment component is designed to provide indi¬ 
vidualized data that informs and personalizes instruction. 
First, formative data are gathered daily for each strategy’s 
various practice activities. For example, checklists are used 
to measure student use of the target skill or strategy during 
partner practice activities. A student partner or the teacher 
watches and listens to the student reader apply a reading 
strategy to a reading task. The partner or the teacher records 
whether the student reader used the strategy being taught. 
This information is used to assess individual student prog¬ 
ress and provide immediate, individualized, positive, and 
corrective feedback to the reader. This information also 
informs decision making relative to adjusting intervention 
intensity and difficulty of reading material. These forma¬ 
tive data are also used to design modifications to the base¬ 
line intervention if students are not making desired 
progress. Second, progress measures are embedded within 
each major unit of the curriculum and administered as pre-/ 
postunit tests. These measures inform the learner and 
teacher as to the level of student mastery of a particular 
reading strategy, mastery of skills being taught, and com¬ 
prehension of reading material. Resulting data are used to 
make program decisions for individual or groups of stu¬ 
dents. Finally, overall achievement gains are documented 


by district end-of-grade assessments or other summative 
standardized reading measures. These data are used to 
assess the overall impact of FR. 

A key structure of FR is the Daily Lesson Format. The 
Daily Lesson Format provides a structure for the class that 
ensures all critical instructional activities are included in 
each class session. For example, during a 60-min class, 
teachers and students rotate through five activities: Warm-up 
(5 min), Thinking Reading (12 min), Explicit Instruction (20 
min), Vocabulary (18 min), and Wrap-up (5 min). The 
instructional activities are as follows: (a) Students do a 
Warm-up activity as soon as they enter the class. The 
Warm-up is usually a vocabulary question related to the 
novel the class is reading. Students earn points for complet¬ 
ing the activity, (b) Students transition to Thinking Reading, 
which involves the teacher modeling the behaviors and 
thinking of an expert reader. Students read highly engaging 
novels during Thinking Reading and eventually demonstrate 
and practice reading strategies they are taught in the class, 
(c) Explicit Strategy Instruction is when teachers explain a 
strategy, model the strategy, have students practice the strat¬ 
egy, and then provide feedback to students. Students are 
taught the individual course reading strategies during this 
time, (d) Next, students study Vocabulary. The process for 
learning vocabulary is described later, (e) During lesson 
Wrap-up, students are given a quick assessment of the main 
skill taught. Usually, this involves having students complete 
an exit ticket assignment. Also, the next lesson is previewed. 
The Daily Lesson Format structure helps ensure that each 
class has instructional variety and that every minute possible 
is an opportunity for explicit instruction. 

A critical and unique feature of the FR is the explicit 
nature of the generalization and application of reading skills 
and strategies to core class text material and district assess¬ 
ments. As students learn and practice strategies, they begin 
with narrative and informational passages written at their 
instructional reading level. As they become more skillful in 
using strategies and in understanding the passages that they 
are reading, they advance to using actual core class materi¬ 
als from language arts, science, social studies, and math. 
The strategies are used in a flexible manner to respond to 
unique demands of each core discipline. This final phase of 
instruction is called Strategy Integration. Strategy 
Integration occurs three times throughout the course. Thus, 
students read core materials and apply multiple reading 
strategies to core materials about 65% of the time, and they 
also apply the strategies to state assessment practice materi¬ 
als to support generalization of skills and strategies to high 
stake assessments. 

How Professional Development Was Provided 

Each FR teacher received extensive professional develop¬ 
ment (PD) from the program developers. In addition, all 
building and district-level administrators who were 
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responsible for curriculum and instruction received PD. The 
importance of deliberately including building and district 
leaders in PD plans in urban secondary schools is well doc¬ 
umented (e.g., McDonald, Klein, & Riordan, 2009). The 
model used to provide all PD was based on validated prac¬ 
tices for professional learning (e.g., Elmore, 2005; Fullan, 
2005; Knight, 2007). 

The specific PD provided to FR teachers included the fol¬ 
lowing: (a) Teachers with responsibility for teaching FR 
were identified as soon as possible and before instruction 
was delivered. During the fall of Year 1, and prior to the 
beginning of classes, teachers were provided three days of 
PD. The PD included information on attributes of struggling 
readers, theoretical underpinnings of FR, classroom routines 
and set up, instructional methodology, student grouping 
strategies, and a review of the instructional materials. In 
addition, the FR teachers were taught how to instruct stu¬ 
dents with the first two units of the curriculum: Establish the 
Course and the Prediction Strategy, (b) During the spring 
semester of Year 1, FR teachers received three additional 
days of PD that included instruction on the PSR and TBS. 
PD included multiple models of experts demonstrating the 
use of each of the strategies, many opportunities for teachers 
to practice teaching the strategies and receive feedback, plus 
opportunities to reflect, ask questions, problem solve, and 
debrief, (c) During the summer, professional developers 
were in frequent contact with the curriculum director and 
special education coordinator to respond to questions, moni¬ 
tor preparation progress, and to provide encouragement and 
motivation for the upcoming year, (d) In August of Year 2, 
FR teachers were provided with a full day review of the 
information from Year 1 and began planning the launch of 
FR Year 2. (e) Once formal instruction began, extensive 
instructional coaching was provided to each FR teacher 
according to the principles of Partnership Instructional 
Coaching (e.g., Knight, 2007, 2009). (f) During the second 
year of instruction, teachers had four additional days of face- 
to-face PD for the purpose of debriefing, problem solving, 
and learning the remaining components of FR. 

The Comparison Condition 

The comparison condition for this study was Corrective 
Reading (CR; see Torgesen et al., 2006). CR is designed to 
promote decoding, fluency, and comprehension skills of 
students in Grades 4 to 12 who are reading below their 
grade level. The program includes four sequential levels 
that address students’ decoding skills and six sequential lev¬ 
els that address students’ comprehension skills. The levels 
are designed to target students who need assistance with 
particular types of reading skills based on the results of CR 
placement tests. The decoding and comprehension compo¬ 
nents can be used separately as a supplemental reading 


intervention or combined for use as a reading intervention 
curriculum. All lessons in the program are sequenced and 
scripted. CR can be implemented in small groups of four to 
five students or in a whole-class format. 

In this study, CR was taught in small groups of students 
(4-8) that met regularly in 50-min sessions five times a 
week throughout the school year. Lessons for Year 1 of the 
studies focused on four sequential levels that addressed stu¬ 
dents’ decoding skills. All teachers in the study who taught 
CR were experienced in teaching the program and had been 
provided PD in how to implement the program. Teachers 
were observed several times throughout the year by their 
special education department chairperson, who reported 
that the program was implemented as intended. 

Measures 

Two measures were used in this study: GRADE (Williams, 
2001) and the Northwest Evaluation Association Measures 
of Academic Progress (MAP). 

The GRADE is a comprehensive reading diagnostic 
assessment for grades PK through 12. The Middle Level 
test (Grades 6-8) includes subtests for Listening 
Comprehension (LC), Vocabulary (VOC), Sentence 
Comprehension (SC), and Passage Comprehension (PCO). 
A composite comprehension (COMP) score is obtained by 
summing the sentence and passage subtests. In this study, 
we administered all GRADE subtests except LC. A total test 
score is obtained by summing the COMP and VOC scores. 
Vocabulary knowledge is assessed by multiple-choice ques¬ 
tions. SC is assessed by choosing a word from a list to fill in 
a missing word in a sentence. PCO is assessed by reading a 
short passage and completing multiple-choice questions. 
The GRADE has high internal consistency reliability esti¬ 
mates ranging from .89 to .99. Alternative form reliability 
(n = 696) ranged from .81 to .94. Corrected coefficients of 
Total Reading scores on the Iowa Test of Basic Skills and 
GRADE suggested concurrent validities that ranged 
between .69 and .83 (n = 185) and from .86 to .90 using the 
Gates-MacGinitie Reading Test. To answer Research 
Questions 1 and 2, we used the GRADE Total Test score, 
which is a measure of overall reading achievement. 

The MAP tests are computerized adaptive assessments that 
have been published by the Northwest Evaluation Association 
(NWEA) since 2000. The purpose of MAP tests is to provide 
educators with infonnation to inform teaching and learning in 
reading, mathematics, and science (NWEA, 2011). For this 
study, we analyzed only the MAP data for the reading portion 
of the total test score. In general, the MAP reading test con¬ 
sists of 40 multiple-choice items with four options. The MAP 
reading test comprises four areas, Word Meaning, Literal 
Comprehension, Interpretive Comprehension, and Evaluative 
Comprehension, which compose an overall MAP reading 
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score. For each state, the MAP tests are aligned to specific 
state content standards by assembling pools of items that 
address state content standards. The marginal reliabilities of 
tests across 50 states and grades are consistently in the low to 
mid-0.90s (NWEA, 2011; Wang, McCall, Jiao, & Harris, 
2013). For the analysis in this study, the MAP was used to 
answer Research Question 3. 

Research Design 

The research design for this study was a quasi-experimental 
matched comparison group design with students matched 
on the following factors: GRADE reading pretest total score 
and student grade-level placement. Students were also 
matched on gender, number of hours served in special edu¬ 
cation classes per day, ethnicity, race, and SES as closely as 
possible (see Table 1). 

Eight special education teachers who expressed interest 
in the study were assigned by district leadership to teach 
either FR or the district’s current reading program, CR. Five 
FR teachers each taught one section of FR to a group of 
three to eight students. All five teachers received the PD 
described earlier. Three comparison teachers each taught 
multiple sections of CR to groups of four to eight students. 
All comparison teachers had previously received PD on 
how to teach CR. 

At the beginning of the school year, 23 students were 
assigned in small groups to the five FR teachers. The stu¬ 
dents were asked if they would like to participate in a 
study of reading programs. All students gave their verbal 
assent and their parents or guardians subsequently signed 
consent letters to participate in the study. Before the start 
of instruction, three students transferred out of the district 
or had their schedules changed so they were no longer able 
to participate. Thus, 20 students remained in the FR condi¬ 
tion. From a pool of CR comparison students who gave 
their verbal assent and had their parents or guardians sign 
consent letters, 20 students were matched on the factors 
described above with the 20 students in the FR condition. 
Thus, 40 students were included in the study, 20 in each 
condition. 

Data Analysis 

Study I: GRADE analysis. The GRADE was administered as 
a pre- and posttest measure during Study 1. Our data had a 
nested structure such that students were nested within class¬ 
rooms and classrooms were nested within schools. Thus, 
we first examined the degree of clustering by calculating 
intraclass correlations (ICCs ) for each of the VOC, SC, PC, 
and COMP subtest scores of the GRADE at baseline. The 
average ICC was .00 at the school level (range = 0 to .03), 
indicating a negligible level of clustering at this level. 


Clustering at the classroom level was nontrivial with an 
average ICC of .04 (range = 0 to .15). Single-level analyses 
were conducted using disaggregation of data at the student 
level. We confirmed that none of the baseline scores signifi¬ 
cantly differed either among schools (p = . 180 to .906) or 
among teachers (p = .519 to .950). 

Then, repeated-measures analysis of covariance (RM 
ANCOVA) was perfonned to examine the changes in the 
overall GRADE scores over time between students who 
received the FR intervention and those who received the 
comparison intervention. The impact of the FR intervention 
was estimated by a group or group-by-time interaction 
effect and an effect size was also reported. The control vari¬ 
ables included in the model were students’ gender, race, 
SES (free/reduced or regular lunch), disability severity 
(percentage of time served in special education classes), 
school, and classroom. 

Preliminary assumption testing was conducted to check 
for normality, linearity, univariate, and multivariate outli¬ 
ers, homogeneity of variance-covariance matrices, and 
multicollinearity. All analyses were conducted using SPSS 
version 22.0. 

Study 2: MAP analysis. The MAP reading measure was 
administered across four time points, fall and spring Year 1 
and fall and spring Year 2, to all students in the study. 
Because more than two time points were collected and 
responses were still nested within students, schools, and 
teachers, scores were not independent of each other. Multi¬ 
level modeling (MLM) was the best tool for data analysis 
(see Raudenbush & Bryk, 2002). MLM for nested data and 
similar procedures are common in educational research 
(e.g., Dettmers, Trautwein, Ludtke, Kunter, & Baumert, 
2010; Shen, Leslie, Spybrook, & Ma, 2012). MLM concep¬ 
tualizes two levels of analysis. The first level (Level 1) con¬ 
sists of each individual’s observed development (e.g., the 
development of MAP scores) over time determined by a set 
of parameters. The second level (Level 2) consists of indi¬ 
vidual characteristics that may predict variance in individu¬ 
al’s growth over time (e.g., classroom, gender, race, SES, 
SPED). We used MLM to estimate (a) how MAP scores in 
this study changed over time, (b) whether individuals dem¬ 
onstrated different trajectories over time and, if they did, (c) 
whether years of Fusion intervention experience predicted 
these differences in trajectories, specifically, and (d) 
whether students who received 2 years of FR had greater 
gains in MAP scores than students who received only 1 year 
of the intervention. The comparison group students received 
CR during Year 1 but received FR instead during Year 2. 
This was a decision made by the district after an analysis of 
the Year 1 data. 

In the mixed models (models including both Level 1 and 
Level 2 predictors), we included years of intervention as a 
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time-varying predictor variable. We included gender, race, 
SES, SPED, classroom, and school as Level 2 control vari¬ 
ables for initial status. Our mixed model was as follows: 

MAP tJ = K 0i +n u ( timepoint ) 

+ Jt 2i ( yearsinterven ) + 

= Too + Yoi [race) + y 02 ( gender ) 

+ y 02 t (SES) + y M {sped) 

+ y 05 ( classroom ) + y 06 ( school ) + £ 0 ; 

= Yio+Cu 
71 2i = Y 20 + ^2i 

MAP data preparation. Prior to analyses, multivariate 
assumptions were checked. Next, the prevalence of missing 
data was examined. Ten subjects were missing data at waves 
3 and 4 and three were missing data at all waves. Thus, only 
70% of the sample was still participating at the end of the 
study. Adolescents with missing data did not differ on MAP 
scores at baseline, t(35) = 1.25, p = .22. It is therefore not 
clear whether data are missing completely at random or not 
missing at random. Missing data were handled with full 
maximum likelihood. All multilevel analyses were con¬ 
ducted using SAS 9.3. 

Descriptive statistics were calculated to describe the 
sociodemographic characteristics of the study sample (see 
Table 1). A model was fit predicting MAP scores. All inde¬ 
pendent variables were categorical and therefore dummy 
coded. Years of intervention (YRSINTERVEN) was coded 
as 0 for 0 years, 1 for 1 year, and 2 for 2 years of experience 
with the Fusion intervention. Gender was a dichotomous 
variable dummy coded so that 0 referred to the males and 1 
referred to females. Race was coded as 0 = Black, 1 = White, 
2 = Asian. SES was a dichotomous variable dummy coded 
so that 0 referred to students who were not receiving free or 
reduced lunches and 1 referred to students who were receiv¬ 
ing free or reduced cost lunches. Severity was a dichoto¬ 
mous variable dummy coded so students who spent 10% to 
25% of the time spent in special disability classes were 0 and 
students who spent 30% to 50% in special disability classes 
were 1. Effects were considered significant if p < .05. 

MAP data were fit according to the following model tax¬ 
onomy: Model A was the unconditional means model and 
Model B was the unconditional growth model. Next, the 
Level 2 predictor variables (school, teacher, classroom, stu¬ 
dents’ gender, race, SES (free/reduced or regular lunch and 
disability severity) were added to the unconditional growth 
model as control variables. Model D added years of FR 
intervention as an additional predictor at Level 1 to Model 


C. Finally, Model E removed the nonsignificant Level 2 
predictors from Model D. Delta deviance scores did not 
show a significant change in model fit when the nonsignifi¬ 
cant Level 2 predictors were removed and therefore the 
more parsimonious model (Model E) was retained. 

Fidelity of Implementation 

A checklist was developed to measure fidelity of imple¬ 
mentation for the experimental condition (see Figure 1). 
The Fusion Reading Fidelity Checklist (FRFC) was divided 
into two major sections: global fidelity to the lesson format 
and fidelity to specific instructional procedures. The fidel¬ 
ity measure measured how closely the design of the Daily 
Lesson Format and instructional practices were followed 
by FR teachers. The fidelity measure included observation 
of six essential lesson components: (a) classroom proce¬ 
dures, (b) daily warm-up activity, (c) Thinking Reading 
activity, (d) direct instruction for reading strategies, 
(e) vocabulary instruction, and (f) wrap-up and end-of- 
lesson comprehension check. Teachers were given points 
for each activity observed for each lesson using a 4-point 
scoring rubric. 

Project researchers trained special education department 
chairpersons and their designees how to use the FRFC by 
scoring video of FR teachers and comparing/discussing 
scores. District staff then observed FR classroom and used 
the FRFC to measure implementation fidelity. About 15% 
of the fidelity observations were scored by two observers. 
Interscorer reliability was determined by the following 
method: The total number of agreements that the checklist 
item was observed plus the total number of agreements that 
the checklist item was not observed were summed. This 
number was divided by the total number of observable 
items possible and a percentage of agreement was calcu¬ 
lated. The percentage of interscorer reliability was deter¬ 
mined to be 86%. 

Results 

Repeated-Measures Multivariate Analysis of 
Covariance for the GRADE 

Research Questions I and 2: Intervention effects for Study I. 
Standardized skewness scores and the Shapiro-Wilk test 
results confirmed normality of data within each group. 
Also, Levene’s test results indicated homogenous variances 
of each score between the intervention and comparison 
groups. 

An RM ANCOVA was conducted on the overall GRADE 
scores. There were significant differences between the 
intervention and comparison group over time, F(l,32) = 6.67, 
p = .015, Hedges’s g= 1.66 (see Table 2). Pretest and post¬ 
test mean and standard deviations for the overall GRADE 
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Teacher Observed_Observer(s) 

Date_Unit:_Lesson: 


CLASSROOM CLIMATE 

1. Classroom Procedures 

Followed bv students? 

Mentioned bv teacher or posted? 

Students engaged? 

Time 1 

Time 2 

Time 3 

COMMENTS: 

LESSON FORMAT 

2. Warm-up 

Time allocation followed? 

Warm-up posted? 

Vocabularv-tvpe question? 

Ouestions about novel? 

Student work reviewed or scored? 


3. Thinking Reading 

Teachers uses strategies while reading aloud? 

Students have “eves on the page?” 

Time 1 

Time 2 

Time 3 

Students answer questions? 

NOTE TYPE OF THINKING READING: 

Teacher led? Forecast? 

Teacher guided? Applv? 

Student led? Integrate? 

4. Explicit Instruction 

Did the teacher describe a skill or strategv? 

Did the teacher model a skill or strategv? 

Did the teacher provide student practice feedback? 

NOTE THE LESSON ACTIVITY: 

Vocabulary 

Book study 

Classroom Procedures 

Possible Selves 

Reading strategv taught- 

5. Vocabulary 

7-step vocab process followed? 

Students engage in discussion? 

1-2 vocab words taught? 


6. Wrap-up 

Current lesson summarized? 

Next lesson previewed? 

Exit ticket activitv conducted? 



Figure I. Fusion Reading Fidelity Checklist. 


score and individual subcomponents can be found in Table 

3. Figure 2 presents the mean scores at baseline and Year 1 
follow-up period for the overall GRADE measure. As 
observed in this figure, the intervention group showed a 
considerable increase, while the comparison group showed 
no or little (if at all) changes over time. This pattern 
of change was supported by significant group-by-time 

interaction effects and relatively large effect sizes (see Table 
2). In summary, these results suggested that the intervention 
showed a positive impact on students’ overall GRADE 
score, even after controlling for various sociodemographic 
factors. 

A second RM ANCOVA was conducted on MAP scores 
from Year 1. There were significant differences between the 
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Table 2. 

Results of Students’ GRADE and MAP Scores After Year 1. 







GRADE 



MAP 



Effect 

F df p 

V 

F 

df 

P 

V 


Between-group 


Gender 

3.73 

1, 32 

.062 

.105 

0.1 14 

1, 27 

.739 

.004 

Race 

0.763 

1, 32 

.389 

.023 

0.759 

1,27 

.391 

.027 

SES 

0.147 

1, 32 

.704 

.005 

0.001 

1,27 

.974 

.000 

Severity 

0.027 

1, 32 

.870 

.001 

0.016 

1,27 

.901 

.001 

School 

2.48 

1, 32 

.125 

.072 

0.738 

1,27 

.398 

.027 

Classroom 

5.13 

1, 32 

.030 

.138 

0.001 

1,27 

.971 

.000 

Group 

9.60 

1, 32 

.004 

.231 

0.157 

1,27 

.695 

.006 

Within-group 

Time 

2.34 

1, 32 

.136 

.068 

1.93 

1,27 

.176 

.067 

Gender x time 

2.02 

1, 32 

.165 

.059 

0.099 

1,27 

.755 

.004 

Race x time 

0.444 

1, 32 

.510 

.014 

0.293 

1,27 

.593 

.011 

SES x time 

1.92 

1, 32 

.176 

.057 

0.197 

1,27 

.661 

.007 

Severity x time 

0.773 

1, 32 

.386 

.024 

4.15 

1, 27 

.052 

.133 

School x time 

0.803 

1, 32 

.377 

.024 

4.82 

1, 27 

.037 

.151 

Classroom x time 

1.29 

1, 32 

.265 

.039 

5.87 

1, 27 

.022 

.179 

Group x time 

6.67 

1, 32 

.015 

.173 

5.16 

1, 27 

.031 

.160 


Note, df = degrees of freedom (numerator, denominator); GRADE = Group Reading and Diagnostic Evaluation; MAP = Measures of Academic Progress; 
SES = socioeconomic status. 


Table 3. Pretest and Posttest Means and Standard Deviations for GRADE and MAP Measures After Year 2. 



Year 1 

Pretest 

Year 1 

Posttest 


Year 2 

Pretest 

Year 2 

Posttest 


Intervention type 

Pretest M 

SD 

Posttest M 

SD 

Hedges’s g 

Pretest M 

SD 

Posttest M 

SD 

Hedges’s g 

VOC 

Comparison 

7.95 

2.70 

9.15 

4.42 

0.328 






Fusion 

8.45 

2.52 

13.70 

6.01 

1.14 






SC 

Comparison 

4.40 

2.19 

5.20 

1.85 

0.395 






Fusion 

4.85 

2.1 1 

7.80 

2.61 

1.24 






PC 

Comparison 

8.50 

3.02 

7.80 

4.70 

0.177 






Fusion 

Overall GRADE 

7.65 

2.50 

12.0 

4.44 

1.21 






Comparison 

20.85 

3.70 

21.70 

7.31 

0.146 






Fusion 

20.95 

3.22 

33.60 

10.29 

1.66 






MAP 

Comparison 

185.47 

9.02 

188.94 

9.40 

0.377 

197.08 

8.42 

201.17 

7.17 

0.523 

Fusion 

186.20 

1 1.12 

195.79 

6.90 

1.04 

187.33 

1 1.38 

199.33 

8.58 

1.19 


Note. GRADE = Group Reading and Diagnostic Evaluation; MAP = Measures of Academic Progress; PC = Passage Comprehension; SC = Sentence 
Comprehension; VOC = Vocabulary. The GRADE was not administered in Year 2, and the comparison group received the FR intervention in Year 2. 


experimental and comparison groups over time; F(\, 27) = 
5.16, p = .031, Hedges’s g = 1.04 (see Table 2). Pretest and 
posttest mean and standard deviations for MAP scores are 
presented in Table 3. The FR intervention improved stu¬ 
dents’ MAP reading assessment score, even after control¬ 
ling for several sociodemographic factors. 


MLM Analysis of MAP Scores After Year 2 

Research Questions I and 3: Intervention effects for Study 2. Table 4 
presents the model results for the model taxonomy. MAP 
scores were grand-mean centered prior to MLM analysis. For 
the final model. Model E, initial MAP scores for students at 
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Figure 2. Mean overall Group Reading and Diagnostic 
Evaluation (GRADE) scores for the intervention and comparison 
group after Year I. 

“School A” at baseline with 0 years of intervention experi¬ 
ence was estimated to be 2.16 points below the mean, on 
average; however, this initial status was not significantly dif¬ 
ferent from the mean. In addition, the rate of change in MAP 
scores over time was associated with lower MAP scores, 7t 
= -M9, p > .80, on average, when controlling for school and 
years of intervention; however, this decrease over time was 
not significant. Critically, the effect of years of intervention 
on current MAP scores, controlling for school and changes in 
MAP over time, was estimated to be 8.00 points higher than 
baseline scores, 1(26) = 3.53, p < .002. Figure 3 illustrates 
differences in MAP scores for students with various years of 
experience with the intervention. 

In MLM the effect sizes shown below are generally 
accepted indices (Raudenbush & Bryk, 2002; Singer & 
Willett, 2003) but are not comparable in the same sense as 
a d or r\ 2 . In general, effect sizes tend to fall into two cat¬ 
egories: global and local. Global effect sizes quantify the 
variance in the response variable explained by all predic¬ 
tor variables in an analysis model, whereas local effect 
sizes quantify the effect of individual variables on the 
response variable. One way to compute the global effect 
size statistic R 2 in multiple regression is to compute the 
predicted score for each participant in the sample, obtain 
the correlation between the observed and predicted scores, 
and square that correlation. Although MLM response 
variable variance is partitioned into Level 1 and Level 2 
components, a pseudo-R 2 (see, e.g., Singer & Willett, 
2003) for a global effect size statistic can be computed in 
a similar manner. 

Returning to the final model for the current study, the 
correlation between the observed and the predicted MAP 
scores was r = .313, and squaring this value suggests that 
9.80% of the variation in MAP scores can be explained by 


years of intervention. Below, we present several pseudo-R 2 
statistics that quantify how much outcome variation is 
explained by a multilevel model’s predictors. By including 
years of intervention as a predictor of MAP scores, we have 
explained 9.80% of the variance in MAP scores from wave 
0 to wave 4. In addition, the Level 1 residual variance 
decreased from 50.19 to 28.81, a difference of 21.38, mean¬ 
ing we have accounted for 42.60% of the within-person 
variance by adding years of intervention to the model. This 
indicates that other variables may account for individual 
differences in the initial status and rate of change of MAP 
scores among this group of students. To summarize, after 1 
year of the FR intervention, students’ MAP scores are esti¬ 
mated to be 8.00 points higher than students with 0 years of 
experience with the Fusion intervention. Furthermore, MAP 
scores continue to increase with every additional year of 
intervention. 

Research Question 4. Fidelity was assessed in FR classes 
using the FRFC (see Figure 1). The FRFC is aligned with 
the Daily Lesson Format described earlier and FR instruc¬ 
tional methods. Observers note whether behaviors listed on 
the FRFC were observed during FR classes. The behaviors 
were scored using a rubric of 0 to 3 points. If the behavior 
was not observed during the class, a score of 0 was recorded. 
A score of 1 point was awarded if the behavior was observed 
few times. A score of 2 points was awarded if the behavior 
was observed some times. A score of 3 points was awarded 
if the behavior was observed most of the time. 

Each teacher was observed 3 to 5 times each semester by 
the special education department chairperson. In addition, 
at least once each semester, research staff observed FR 
teachers with district staff and scores were compared to 
support the reliability of observations. For the five FR 
teachers, the overall fidelity score was 2.3 points out of 3.0 
possible points (see Table 5). Fidelity scores for classroom 
procedures, warm-up, thinking reading, and direct instruc¬ 
tion were high (2.76 to 2.86). Scores for vocabulary and 
wrap-up were low (1.10 for vocabulary and 1.05 for 
wrap-up). 

Fidelity of implementation for CR was evaluated by 
observation from the special education chairperson for each 
school. The observers reported that the comparison reading 
program was implemented as intended. However, no formal 
implementation checklist was used to quantify fidelity. 

Discussion 

The findings from this study of sixth and seventh grade stu¬ 
dents with reading disabilities indicated that students who 
received the FR program performed significantly higher on 
standardized measures of reading than students receiving a 
comparison program. Specifically, in Study 1, students in the 
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Table 4. Model Taxonomy Results for MAP Scores After Year 2. 


Model A 

Model B 

Model C 

Model D 

Model E 

Intercept 






Intercept (nj 

-0.141 

-5.30** 

-6.71 

2.54 

-2.16 

Race (nj 



-0.957 

-l.l 1 


Gender (n oj ) 



1.20 

-1.27 


SES (" 03 ) 



1.54 

3.03 


s P ed ( n 0 „) 



1.08 

-0.167 


Classroom (tt o5 ) 



0.352 

0.772 


School (TTj 



-1.13 

-3.91* 

-1.56 

Wave 






Intercept (tt | o ) 


4 02 *** 

4.03*** 

-0.31 

-0.439 

Years of Intervention 






Intercept (tt m ) 




8.07** 

8 . 00 ** 

Res. var initial 

37.54** 

46.84* 

50.87* 

63.1 1** 

59.90** 

Res. var wave 


3.89 

3.87 

63.81** 

65.59** 

Res. var interven 




59.19 

66.99 

Cov (int, wave) 


-5.64 

-7.99 

-18.22 

-13.42 

Cov (int, interven) 




13.10 

10.34 

Cov (wave, interven) 




-66.49 

-70.85 

LI res. var 

79.06*** 

50.19*** 

50.36*** 

29 14 *** 

28.81*** 

Deviance 

950.60 

914.40 

913.00 

880.5 

884.00 

Delta deviance 


36.20*** 

1.4 

33.90*** 

3.5 


Note. MAP = Measures of Academic Progress. Statistical notation provided in parentheses corresponds to the equations provided in the analysis section. 
*p < .05. **p < .01 . ***p <.001. 



Figure 3. Estimated model-based trajectory of Measures of 
Academic Progress (MAP) scores at Year 2. 

FR program made statistically significant gains for total test 
scores on the GRADE standardized reading achievement 
measure and measures of academic progress. The effect size 
of these gains ranged from Hedges’s g= 1.04 to 1.66, which 
are large effects (Cohen, 1988; Richardson, 2011). When one 
considers that an average effect size gain in reading for stu¬ 
dents in sixth and seventh grade is 0.23 (Lipsey et al., 2012), 


the impact of FR on student reading achievement can be 
substantial. 

In Study 2, students who received the FR program for 
longer periods of time significantly outperformed students 
who received FR for less time. These results were measured 
on the MAP reading assessment. Students with 1 year of 
experience with FR were estimated to score 8.00 points 
higher on the MAP than students who had not experience 
with FR. In addition, the MLM model explained 42.60% of 
the within-person variance. The differences in reading 
scores for students in Study 2 were statistically significant 
with 42.60% of the within-person variance of explained by 
the MLM model. This finding supports conclusions from 
other studies (e.g., Lovett et al., 2012; Torgesen et al., 2006; 
Vaughn et al., 2013) that show adolescents with severe 
reading disabilities may require extended periods of instruc¬ 
tion to close reading achievement gaps. 

These findings are similar to those of other studies of 
adolescent reading interventions for middle school students 
(e. g., Vaughn et al., 2013). However, the magnitude of the 
gains of students in the FR program shows significant and 
large effects in overall reading achievement as measured by 
the GRADE and MAP assessments. 

We believe these student gains were the result of several 
factors. First, due to the structured nature of FR classrooms, 
teachers were involved in direct instruction activities through¬ 
out each lesson and engaged students in learning; there was 
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Table 5. 

Fusion Reading Fidelity. 







Teacher 

Classroom procedures 

Warm-up 

Thinking reading 

Direct instruction 

Vocabulary 

Wrap-up 

Overall fidelity 

1 

3 

2.5 

3 

3 

1 

1.3 

2.3 

2 

2.3 

2.3 

2.3 

2.3 

1.5 

0.5 

1.9 

3 

3 

3 

3 

3 

0 

2.3 

2.4 

4 

3 

3 

3 

3 

3 

2.3 

2.9 

5 

3 

3 

3 

3 

0 

0 

2.0 

M 

2.86 

2.76 

2.86 

2.86 

1.10 

1.05 

2.3 


Note. The range of scores possible is 0 to 3 for each category. A score of 0 indicates the behaviors were not observed at all. A score of I indicates 
very few of the behaviors were observed. A score of 2 indicates that some of the behaviors were observed. A score of 3 indicates that most of the 
behaviors were observed. 


no downtime. Second, all of the component reading skills 
were included in the FR program. That is, students received 
explicit instruction in phonics, decoding, word identification, 
fluency, vocabulary, and comprehension over 2 full years. 
Third, teachers provided scaffolded support as students had 
multiple opportunities to apply and generalize reading skills 
and strategies to core class material. Thus, reading strategies 
were not taught in isolation. Finally, we believe that FR 
instruction and activities reengaged students with disabilities 
in the process of reading through the use of culturally respon¬ 
sive, high-interest reading materials and in instruction that 
was designed for student success. 

The data also show the effects of the summer slump or 
slide. The summer slump or slide is well documented (e.g., 
Alexander Entwisle, & Olson, 2007; Allington et al., 2010; 
National Center for Education Statistics, 2011). Specifically, 
researchers have found that while low-income children 
made significant gains in reading achievement during the 
school year, these gains slipped away over the summer due 
to the lack of summer learning activities (Alexander et al., 
2007). Students in both conditions in the current study lost 
ground over the summer but eventually made up for the loss 
during Year 2 of the program. For example. Year 1 FR stu¬ 
dents improved from a fall pretest score of 186.20 on the 
MAP reading measure to a spring posttest score of 194.55, 
a gain of 8.35 points. However, when tested with the MAP 
the following fall, the same students scored 187.33, a loss of 
7.22 points. This loss was recovered during Year 2 of FR 
and students scored 12 points higher on the Year 2 MAP 
posttest, but may have scored even higher if the summer 
slide had been addressed. 

Limitations 

There are several limitations to this study. First, the fact that 
there is no direct data on fidelity of implementation of the CR 
program limits the comparison. Whether CR was fully imple¬ 
mented as designed and whether and where instructional 
overlap occurred between CR and FR is unknown. For exam¬ 
ple, both CR and FR are explicit instruction models, and 
explicit instruction has been found to positively impact 


reading outcomes for students with disabilities (e.g., 
Swanson, 1999a). Not knowing if CR had been taught explic¬ 
itly as was designed limits our understanding of what works. 
Second, the sample size is small and includes only students 
with IEPs and reading goals, thereby limiting generalizability 
of the results. In addition, the matched comparison group 
joined the experimental group, limiting Study 1 to only 1 
year of the 2-year program. Thus, the full impact of the 2-year 
program was not fully tested in Study 1. 

Finally, we acknowledge the potential impact of exten¬ 
sive PD and, more important, the potential of instructional 
coaching to affect student outcomes. Our focus on PD and 
instructional coaching (Knight, 2007, 2009) may have 
helped teachers implement FR at a deep level. That is, they 
came to own FR and made it responsive to the unique con¬ 
text of each school and classroom. They creatively enhanced 
the program while avoiding lethal mutations to essential 
components. Thus, we hypothesize that PD is important and 
instructional coaching is essential for deep implementation 
and improved student achievement. What level of student 
outcome growth would have been obtained with traditional 
PD and less intensive instructional coaching are unknown. 
The impact of PD and coaching on student reading out¬ 
comes is an area in need of future research. 

Implications 

FR is a supplemental reading program that can be effective 
if certain systems and structures are in place. For example, 
a supplemental course requires scheduling support, exten¬ 
sive PD and coaching, a dedicated classroom, and instruc¬ 
tional materials. Teachers need extended time to teach; FR 
requires that students attend the class five times a week for 
at least 50 min each day. Scheduling challenges in middle 
and high schools need to be addressed before effective sup¬ 
plemental instruction can be delivered to all students with 
severe reading disabilities. 

We are convinced that there is no short-term solution to 
the challenge of improving the reading outcomes of students 
with reading disabilities. Thus, FR is a 2-year curriculum. 
We think it could be a three-year curriculum covering Grades 
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6, 7, and 8 to meet the needs of the most severely disabled 
adolescent readers. Finally, the direct link of supplement 
reading courses to core class material is critical for general¬ 
ization of reading skills. Supplemental reading programs 
that are decontextualized from core class text materials may 
be one reason for the limited long-term effects of some cur¬ 
rent reading programs. 

The research reported here reflects an effort to incorporate 
elements of what is known to be effective reading instruction 
for adolescents with significant reading disabilities into a cohe¬ 
sive and comprehensive reading program. In this program, 
teachers explicitly teach important word-level skills (i.e., pho¬ 
nics, decoding word recognition, fluency), vocabulary, com¬ 
prehension, motivational skills, and strategies. In addition, 
teachers scaffold support as students apply newly acquired 
reading skills and strategies directly to relevant core class texts 
and assessment materials. Students actually apply skills and 
strategies to their core class materials about 65% of the time 
they are engaged in reading activities. 

We feel that this recipe is unique in its explicit instruc¬ 
tional methodology, comprehensive scope, motivational 
component, and structured application of skills and strate¬ 
gies to current core class materials. We believe that this 
structure and focus account, in large measure, for the prom¬ 
ising student learning gains reported in this article. 
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